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BACKGROUND OF THE INVENTION 

The present invention relates to security in 
exchanging data via a network, and particularly relates 
to security in transmitting an original image or 
5 processed data of a partial image or the like produced 
by working the original image when an image obtained by 
scanning a form, chit, slip or the like is electron- 
ically exchanged via a network. 

As technology relating to security in data 
10 transmission, for example, there has been known a 

digital signature disclosed, for example, in S. Tujii 
and M. Kasahara: Cryptography and Information Security, 
p. 127-139, SHOKODO (1999). 



SUMMARY OF THE INVENTION 

15 Fig. 7 is a block diagram showing an example 

of the configuration of a data transmission apparatus 
for transmitting data obtained by working or processing 
an input image of a form or the like. 

When data is transmitted between a branch 

20 office A 1000 and a processing center 1005 connected 

via a network 1010 as shown in Fig. 7, a data reception 
side can verify that received data was transmitted from 
a proper transmission side, and can verify that the 
received data has not been substituted. Such verifica- 
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tion is realized by private (public) key cryptography 
using a secret key and a private (public) key produced 
by the transmission side. 

Fig. 2A shows an example of processing flow 
5 of data transmission using a digital signature in the 
data transmission apparatus shown in Fig. 7. Object 
data DA to be transmitted is obtained (Step 200). A 
hash function is applied to the object data DA (Step 
205). The output of the hash function is ciphered with 
10 a secret key KEA of the data transmission side so that 
signed data SA is produced (Step 210). The data DA and 
SA are transmitted to the data reception side (Step 
215). On the other hand, Fig. 2B shows an example of 
processing flow for verifying the validity of the 
15 transmitted data. Object data DA' and signed data SA' 
are obtained (Step 220). A hash function is applied to 
the data DA' (Step 225). The signed data SA' is 
enciphered with a private key KDA distributed in 
advance (Step 230). Then, the results of Step 225 and 
20 Step 230 are compared (Step 235), and the validity of 
the data is verified on the basis of the result of the 
comparison (Step 240). Here, it is concluded that 
there has been no illegal act if the compared data are 
coincident with each other, and there was some illegal 
25 act if they are not coincident with each other. 

However, there is no way to verify whether 
the processed data was produced from the original image 
or not and carry out the aforementioned verification at 



the same time. Further, if the data has been substi- 
tuted, there is no way to find the original image. 

In governmental or non-governmental offices 
dealing with a vast volume of forms, slips, chits or 
5 the like, there are needs to convert paper media into 
digital media and connect deployed centers and branch 
offices to use the digital media to thereby speed up 
services. To satisfy such needs, there has appeared a 
configuration of service in which paper media are 

10 converted into images and the images are applied to a 
work flow. In such a configuration, processed data 
such as partial images required for services are 
managed on account of efficiency in data transmission 
or the like. Such partial images of a medical/ 

15 insurance document as shown in Fig. 6, of original 
images, partial images required for services, for 
example, a reference number, a consultation month, a 
medical code, a room number, a birth date, etc. are cut 
out or picked up and transmitted from the branch office 

20 A 1000 to the processing center 1005 via the network 
1010 in Fig. 7. If the whole of the original image is 
to be transmitted, the volume of data becomes large. 
In addition, if the original image is displayed, there 
is a fear that information involving privacy leaks out. 

25 Therefore, required partial images are cut out or 

picked up and transmitted from the branch office A to 
the processing center. Operators engage in data input 
service while viewing the displayed partial images. 
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However, when data is transmitted via a 
network, original images or processed data flowing on 
the network may be eavesdropped or listened in or 
illegally substituted partially or wholly. Further, 
5 illegal transactions may be achieved by impersonation. 
It is desired to prevent such problems. In order to 
prevent such problems, it is necessary to verify an 
illegal act of substitution based on impersonation. 

As a method of the verification, a digital 

10 signature based on private key cryptography has been 
known as described above. However, if the original 
image or the processed data per se is listened in and a 
secret key used in an image input portion or a 
processed data processing portion is stolen, the 

15 eavesdropper or listener-in may substitute the original 
image or the processed data easily or transmit data to 
a transmission line by impersonation. Thus, there 
arises a problem that the data reception side cannot 
detect such an illegal act and may be deceived and make 

20 an inappropriate process. Therefore, it is desired to 
provide a method for verifying substitution of the 
original image or the processed data based on imper- 
sonation while verifying whether the processed data was 
produced from the original image or not and further for 

25 finding the original image easily if it is concluded 
that the original image has been substituted. 

In addition, if the transmitted data has been 
substituted, it is necessary to find the substituted 
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original image in early stages and extract necessary 
information again. 

It is an object of the present invention to 
provide a method in which in the case where an original 
5 image or processed data was listened in and a secret 
key used in a data input portion or in a processed data 
processing portion was stolen, even if the listener-in 
transmits substituted data of the original image or the 
processed data by impersonation, the data reception 
10 side judges such an illegal act and verifies whether 
received data was produced from the original image or 
not. 

It is another object of the present invention 
to provide a method in which the data reception side 
15 verifies whether the processed data is produced from 
the original data or not, and if the data reception 
side finds that the received data is substituted image, 
the data reception side obtains the original image 
quickly. 

20 In order to attain the foregoing objects, in 

a data transmission method according to an aspect of 
the present invention, a data transmission side merges 
processed data DB obtained by working or processing an 
original image DA with signed data SA obtained by 

25 applying a digital signature to the original image. 
Then, the data transmission side applies a one-way 
function to the merged data, and ciphers the output of 
the one-way function with a secret key of the data 



transmission side so as to obtain signed data SB. 
Then, the signed data SA obtained by applying a digital 
signature to the original image DA is ciphered with a 
private key of a data reception side so that ciphered 
5 signed data SAE is obtained. Then, the data trans- 
mission side transmits the processed data DB, the 
signed data SB and the ciphered signed data SAE to the 
data reception side. 

On the other hand, the data reception side 

10 obtains ciphered signed data SAE ' and enciphers the 

ciphered signed data SAE' with a secret key of the data 
reception side to thereby obtain signed data SA' . The 
data reception side merges obtained processed data DB' 
with the signed data SA' , and applies a one-way 

15 function to the merged data. Then, the data reception 
side enciphers obtained signed data SB' with a private 
key of the data transmission side, and compares the 
output of the one-way function applied to the merged 
data obtained by merging the processed data DB' and the 

2 0 signed data SA' with the result of enciphering the 

signed data SB' with a private key of the data trans- 
mission side. Thus, data validity is verified. 

In the date transmission method according to 
another aspect of the present invention, the data 

25 transmission side merges an original image DA with 

signed data SA obtained by applying a digital signature 
to the original image. Then, the data transmission 
side applies a one-way function to the merged data, and 



ciphers the output of the one-way function with a 
secret key of the data transmission side so as to 
obtain signed data SB. The signed data obtained by 
applying a digital signature to the original image DA 
5 is ciphered with a private key of a data reception side 
so that ciphered signed data SAE is obtained. Then, 
the data transmission side transmits the original image 
DA, the signed data SB and the ciphered signed data SAE 
to the data reception side. 

10 On the other hand, the data reception side 

obtains ciphered signed data SAE' and enciphers the 
ciphered signed data SAE' with a secret key of the data 
reception side to thereby obtain signed data SA' . The 
data reception side merges obtained original image DA' 

15 with the signed data SA' , and applies a one-way 

function to the merged data. Then, the data reception 
side enciphers obtained signed data SB' with a private 
key of the data transmission side, and compares the 
output of the one-way function applied to the merged 

20 data obtained by merging the original image DA' and the 
signed data SA' with the result of enciphering the 
signed data SB' with a private key of the data trans- 
mission side. Thus, data validity is verified. 

According to a feature of the present 

25 invention, in place of the signed data SA obtained by 
applying a digital signature to the original image in 
the data transmission apparatus according to the 
present invention described in the first and in the 



last, signed data obtained by applying a digital signa- 
ture to data associated with the original image may be 
used. As the data associated with the original image 
data, for example, the volume of data of the original 
image, the number of black pixels included in a 
binarized image obtained by processing the original 
image, and so on, may be used. 

Another feature of the present invention is 
as follows . When disagreement is given as the result 
of comparison of the output of the one-way function 
applied to the merged data with the result of encipher- 
ing the signed data SB' with the private key of the 
data transmission side in the data transmission 
apparatus according to the present invention described 
in the first and in the last: 

the data reception side transmits the signed 
data SA' obtained by enciphering the received ciphered 
signed data SAE ' with the secret key of the data 
reception side to the data transmission side; and 

the data transmission side searches for an 
original image corresponding to signed data coinciding 
with the signed data SA' sent to the data transmission 
side. 

According to a further aspect of the present 
invention, a data transmission apparatus comprises: 

first ciphering means for receiving an 
electronic image of an original image and a first 
secret key as inputs, and outputting a first digital 
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signature obtained by ciphering the electronic image 
with the first secret key; 

processing means for receiving the electronic 
image as input, and outputting a partial or processed 
5 image of the electronic image; 

second ciphering means for receiving the 
partial or processed image, the first digital signature 
and a second secret key as inputs, merging the partial 
or processed image and the first digital signature, 
10 ciphering obtained merged data with the second secret 
key, and outputting an obtained second digital signa- 
ture; 

third ciphering means for receiving the first 
digital signature and a private key as inputs, and 
15 obtaining ciphered data of the first digital signature 
with the private key; and 

transmitting means for transmitting the 
partial or processed image, the second digital signa- 
ture, and the ciphered data of the first signature to 
20 an external data channel. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The forgoing and other objects, features and 
advantages of the invention will be apparent from the 
following more detailed description of the preferred 
25 embodiments of the invention as illustrated in the 
accompanying drawings wherein: 

Figs . 1A and IB are flow charts showing data 
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transmission side processing and data reception side 
processing in a data transmission method according to 
an embodiment of the present invention, respectively; 

Figs. 2A and 2B are flow charts showing data 
5 transmission side processing and data reception side 
processing in a data transmission method using a 
digital signature in a data transmission apparatus as 
shown in Fig. 7, respectively; 

Fig. 3 is a flow chart showing processing on 
10 the data transmission side in a data transmission 

method according to another embodiment of the present 
invention in the case where there is a processing 
module of producing a plurality of partial images; 

Fig. 4 is a flow chart showing processing on 
15 the data reception side in a data transmission method 
according to another embodiment of the present 
invention in the case where there is a processing 
module of producing a plurality of partial images; 

Fig. 5 is a view showing a flow from data 
20 transmission to data reception about an original image, 
processed data, signed data, etc. useful for descrip- 
tion of the embodiment of the present invention; 

Fig. 6 is a view showing examples of 
necessary partial images in an original image which is 
25 an object to be worked; 

Fig. 7 is a block diagram showing an example 
of configuration of a transmission system to which the 
present invention is applied; and 
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Figs. 8A and 8B are flow charts showing data 
transmission side processing and data reception side 
processing in a data transmission method according to 
another embodiment of the present invention, respec- 
5 tively. 

DESCRIPTION OF THE EMBODIMENTS 

The present invention utilizes a digital 
signature based on private key cryptography. The 
principle will be described with reference to Fig. 5 

10 and Figs. 1A and IB. In a rough flow of data, an 
original image 720 is obtained by an image input 
operation at an image input portion 700 of a branch 
office 780, and is worked or processed at a processing 
operation portion 705. Then, processed data 730 is 

15 transmitted from a data transmission server 785 to a 
service process portion of a processing center 710 via 
networks 750 and 715 so as to be subjected to a 
service. In this flow, if listen- in is carried out on 
the networks and a secret key used in the image input 

20 operation or the processing operation is stolen, there 
arises a problem of data substitution by impersonation. 

Next, in order to explain the principle, 
description will be made about data to be dealt with. 
Reference numeral 720 represents an original image of 

25 information written on a recording medium such as paper 
read out by scanning the recording medium with a 
scanner 704; 725, signed data obtained by a digital 



signature using a secret key used in the image input 
operation; 73 0, processed data processed or worked in 
the processing operation portion; 735, the signed data 
725; 740, signed data obtained by merging the processed 
5 data 73 0 and the signed data 735 to thereby form one 
unit of merged data and applying a digital signature to 
the merged data with a secret key of the processing 
operation portion; 745, data obtained by ciphering the 
signed data 735 with a private key used in the service 

10 process of the processing center 710; 755, a data group 
to be transmitted to the processing center 710, 
constituted by the data 73 0, 745 and 74 0. Further, 
reference numeral 760 represents data including data 
765 obtained by listening in to the data group 755 on 

15 the network 750 and substituting the data 73 0, and 
signed data 770 obtained by merging the data 7 65 and 
745 to thereby form a block of merged data and applying 
a digital signature to the merged data with the secret 
key stolen from the processing operation portion. 

20 Reference numeral 775 represents substituted data sent 
to and received by the processing center 710 by 
impersonation . 

Conventionally, signed data obtained by a 
digital signature using the processed data 730 and the 

25 secret key in the processing operation unit is used. 
Therefore, a listener-in who stole the secret key in 
the processing operation portion can substitute the 
processed data easily, make up the signed data and 



transmit those data to the processing center while 
impersonating the processing portion. However, the 
data reception side cannot verify such an illegal act. 

Fig. 1A is a flow of processing on the data 
5 transmission side in Fig. 5. Object data DA which is 
an original image and processing information are 
obtained (Step 100). Here, for example, when a partial 
image is dealt with, the processing information means 
coordinates of a partial area to be dealt with. Then, 

10 processing with the object data DA and the processing 
information is performed (Step 105), and a digital 
signature is applied to the object data DA so that 
signed data SA is obtained (Step 107). The signed data 
SA is ciphered with a private key KDC used in the 

15 service process of the data reception side so that 

ciphered signed data SAE is obtained (Step 110). Next, 
the processed data DB and the signed data SA are merged 
to form a block of data DC (Step 115). A hash function 
is applied to the merged data DC (Step 120), and the 

2 0 output of the hash function is ciphered with a secret 
key used in the processing operation portion so that 
signed data SB is obtained (Step 125). The data DB, SB 
and SAE are transmitted to the data reception side 
(Step 130). Here, the data DB corresponds to the data 

25 730 in Fig. 5; SB, the data 740; and SAE, the data 745. 

On the other hand, Fig. IB is a flow of 
processing carried out on the data reception side in 
Fig. 5. Here, received processed data DB', signed data 



SB' and ciphered signed data SAE ' are obtained (Step 
135). The ciphered signed data SAE ' is enciphered with 
a secret key KEC of the service process portion of the 
data reception side so that data SA' is obtained (Step 
5 140). The data DB ' and SA' are merged to form a block 
of data (Step 145 ), and a hash function is applied to 
merged data DC (Step 150). Then, the signed data SB' 
is enciphered with a private key KDB of the processing 
operation portion of the data transmission side (Step 

10 155). The results of Step 150 and 155 are compared 
(Step 160). On the basis of the result of the 
comparison, the data reception side can verify whether 
an illegal act was effected or not (Step 165). 

The important point in this processing is the 

15 fact that one who can encipher the ciphered signed data 
SAE' is the data reception side because the data 
reception side has a secret key thereof. Even if a 
listener-in substitutes data or remakes signed data 
with the substituted data and the ciphered signed data, 

20 the results in Step 160 cannot agree with each other. 

As is understood from the aforementioned 
flow, the ciphered signed data is not always required 
to be signed data of the original image, but it may be 
information relating to the original image, or the 

25 like. Examples of the information relating to the 
original image include: the volume of data of the 
original image; the number of black pixels included in 
a binarized image obtained by processing the original 



image; and so on. 

The verification as to whether the processed 
data was produced from the original image or not is 
effected by comparing the values obtained by Steps 150 
5 and 155 in Fig. IB. If both the values are equal to 
each other, it is proved that the processed data was 
produced from the original image without any illegal 
act based on listen-in. Conversely, if the values are 
different from each other, there is a possibility that 

10 the data has been substituted. In such a case, it may 
be considered that the identification (ID) of the 
original image cannot be found from the substituted 
data. In such a case, the ciphered signed data 
transmitted to the data reception side is enciphered on 

15 the data reception side, and the enciphered signed data 
is sent to the data transmission side. The data trans- 
mission side searches for data-transmission-side signed 
data of the original image coinciding with the 
enciphered signed data. Thus, the original image can 

20 be found out. 

Another embodiment will be described with 
reference to Fig. 3 about the processing operation in 
which a plurality of partial images are produced. 

In this case, Steps 300 to 310 are the same 

25 as Steps 100 to 110 in Fig. 1A. Data processing from 
Step 320 to Step 335 branching from Step 315, which are 
executed for each of the partial images, are the same 
as that from Step 115 to Step 13 0 in Fig. 1A. The 



processing flow of Fig. 3 is different from Fig. 1A in 
that Step 315 executes the data processing repeatedly 
several times. 

Fig. 4 is a flow of processing for verifica- 
5 tion about transmitted data, which flow corresponds to 
the processing in Fig. 3. In the same manner as on the 
data transmission side, Steps 400 to 405 in Fig. 4 are 
the same as Steps 135 to 140 in Fig. IB. Data process- 
ing from Step 415 to Step 435 branching from Step 410, 

10 which are executed for each of the partial images, are 
the same as that from Step 145 to Step 165 in Fig. IB. 
The processing flow of Fig. 4 is different from Fig. IB 
in that Step 410 executes the data processing 
repeatedly several times. 

15 Thus, the partial images can be transmitted 

to the data reception side without being extracted and 
subjected to any illegal act based on listen-in. In 
addition, such an illegal act based on listen-in can be 
verified. 

20 Although description was made above about 

security against listen- in on the transmission of 
processed data, it is possible to prevent an attack on 
the original image from a listener-in in the same 
manner as the processed data. 

25 Description will be made below about a data 

transmission method according to another embodiment of 
the present invention which can verify an illegal act 
of a listener-in to the original image. 
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Figs. 8A and 8B show processing flows when 
object data DA which is an original image is exchanged 
between a data transmission side and a data reception 
side. Steps similar to those in Figs. 1A and IB are 
5 referenced correspondingly. 

Fig. 8A is a flow of processing carried out 
on the data transmission side. A digital signature is 
applied to the object data DA which is an original 
image, so that signed data SA is obtained (Step 107). 

10 The signed data SA is ciphered with a private key KDC 
of a service process portion of the data reception 
side, so that ciphered signed data SAE is obtained 
(Step 110). Next, the object data DA and the signed 
data SA are merged to form a block of data (Step 115'). 

15 A hash function is applied to merged data DC with a 

secret key of the data transmission side so that signed 
data SB is obtained (Step 125). The data DA, SB and 
SAE are transmitted to the data reception side (Step 
130) . 

20 On the other hand, Fig. 8B is a flow of 

processing carried out on the data reception side. 
Here, object data DA', signed data SB' and ciphered 
signed data SAE' are received (Step 135'). The 
ciphered signed data SAE' is enciphered with a secret 

25 key KEC of the service process portion of the data 

reception side so that data SA' is obtained (Step 140). 
The data DB' and SA' are merged to form a block of data 
(Step 145'), and a hash function is applied to merged 



data DC (Step 150). Then, the signed data SB' is 
enciphered with a private key KDB of the data trans- 
mission side (Step 155). The results of Steps 150 and 
155 are compared (Step 160). On the basis of the 
5 result of the comparison, it is possible to verify 

whether an illegal act was effected or not (Step 165). 

Similarly to the embodiment of Figs. 1A and 
IB, the important point in this processing is that one 
who can encipher the ciphered signed data SAE ' is the 

10 data reception side because the data reception side has 
a secret key thereof. Even if a listener-in substi- 
tutes data or remakes signed data with the substituted 
data and the ciphered signed data, the results in Step 
160 cannot agree with each other. Also in this embodi- 

15 ment, the ciphered signed data is not always necessary 
to be signed data of the original image, but it may be 
information relating to the original image, or the 
like. Thus, also in this embodiment, advantageous 
effects similar to those in the embodiment of Figs. 1A 

20 and IB can be obtained. 

Conventionally, when data produced by a 
digital signature is listened in on a network and a 
secret key used therefor is stolen, there has arisen a 
problem that the listener-in may substitute the data 

25 and transmit the substituted data by impersonation so 
that wrongful processing is carried out on the data 
reception side. However, according to the afore- 
mentioned embodiments, such a data substitution or such 
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an illegal act based on impersonation can be verified 
on the data reception side. 

While the invention has been particularly 
described and shown with reference to the preferred 
5 embodiments thereof, it will be understood by those 
skilled in the art that various changes in form and 
detail and omissions may be made therein without 
departing from the scope of the invention. For 
example, although the above description is aimed at the 

10 case where images obtained by scanning paper and there- 
after processing are exchanged via networks, the 
present invention is not limited to such a case. For 
example, it is also applicable to the case where forms 
or the like are stored in recording media such as 

15 magnetic disks, optical disks, semiconductor memories, 
or the like, and images obtained by reading out 
original images from such recording media and there- 
after processing the original images are exchanged via 
networks . 



